Using status indicators in an item caching environment

ABSTRACT

A media item cache manager system which implements techniques for efficiently using cache memory to respond to requests. The cache memory may include information on items along with a status indicator for each of the items, indicating different status information. Some examples of possible status indicators include valid, invalid, or in-progress indicators.

RELATED CASES

This application is related to the following applications: (1) U.S.patent application Ser. No. 15/445,451, “Increasing Coverage ofResponses for Requests through Selecting Multiple Native Content Items,”filed on Feb. 28, 2017; (2) U.S. patent application Ser. No. 15/445,781,“Multi-Step Validation of Content Items based on Dynamic PublisherRequirements,” filed on Feb. 28, 2017; (3) U.S. patent application Ser.No. 15/445,742, “Reducing Load to Downstream Services by FilteringRequests,” filed on Feb. 28, 2017; and (4) U.S. patent application Ser.No. 15/445,791, “Progress Tracking for Requests Made Through anIntermediary,” filed on Feb. 28, 2017. These applications are herebyincorporated by reference in their entirety, for all purposes.

TECHNICAL FIELD

The present disclosure relates to data processing and, morespecifically, to efficiently referencing data stored as cache data.SUGGESTED GROUP ART UNIT: 2161; SUGGESTED CLASSIFICATION: 707/795.

BACKGROUND

The availability of various content items on the Internet allows accessto information in bulk. However, the sheer volume of content itemsavailable does not increase the usefulness of the content items. Theinformation presented in the content items themselves should be relevantto each user. For example, a user interested in learning about currentpolitical developments may request content items. Content items withinformation on living and style may be irrelevant to the user, eventhough the same content item may be enjoyable for another user.

Other than matching relevant content items to users' requests, thevolume of content items has also made it difficult to select and providecontent items in a timely manner. For example, if a content item is notprovided within certain time criteria, then a user may have a poorWebsite experience (e.g., slowly loading Web pages, incorrectly renderedWeb pages) or other undesirable effects. Users may grow frustrated andchoose to never view content items from that Website again, even if thecontent items are particularly relevant.

To increase the speed of responding to requests in a request processingsystem, cache memory may be used. For example, cache memory may be usedto store content items or pieces of content items. However, cache memoryis limited by the size of the memory available to the cache and howefficiently the cache memory stores, selects, and retrieves information.

Therefore, it is desirable to have improved methods to match users withcontent items within specified time constraints by using cache memoryefficiently.

The approaches described in this section are approaches that could bepursued, but not necessarily approaches that have been previouslyconceived or pursued. Therefore, unless otherwise indicated, it shouldnot be assumed that any of the approaches described in this sectionqualify as prior art merely by virtue of their inclusion in thissection.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawings:

FIG. 1 illustrates a request processing system in which the techniquesdescribed may be practiced according to certain embodiments.

FIG. 2 is a flow that illustrates an example method for using cachememory in the media item cache manager system.

FIG. 3 is a flow that illustrates an example method for preloadinginformation to a cache in the media item cache manager system.

FIG. 4 is a block diagram that illustrates a computer system upon whichan embodiment of the invention may be implemented.

DETAILED DESCRIPTION

In the following description, for the purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of the present invention. It will be apparent, however,that the present invention may be practiced without these specificdetails. In other instances, well-known structures and devices are shownin block diagram form in order to avoid unnecessarily obscuring thepresent invention.

Embodiments are described in sections below according to the followingoutline. The outline and headings used in the outline are providedmerely for reference purposes. Features discussed following each headingdo not limit the features as being required by a specific embodimentidentified by each heading and do not limit the features as solelybelonging to any specific embodiment identified by each heading.

1.0 GENERAL OVERVIEW

-   -   1.1 NATIVE CONTENT ITEMS    -   1.2 MEDIA ITEMS

2.0 STRUCTURAL OVERVIEW

3.0 EXAMPLE METHOD FOR USING A CACHE

-   -   3.1 DETERMINE WHETHER CACHE RESULT IS USABLE    -   3.2 UNUSABLE CACHE RESULT    -   3.3 MEDIA ITEMS RETRIEVED SIMULTANEOUSLY

4.0 EXAMPLE METHOD FOR PRELOADING INFORMATION

-   -   4.1 AVAILABLE TIME TO RESPOND TO REQUEST    -   4.2 RELATED MEDIA ITEMS

5.0 EXAMPLE EMBODIMENT OF A MEDIA ITEM CACHE MANAGER SYSTEM

6.0 IMPLEMENTATION EXAMPLE—HARDWARE OVERVIEW

1.0 General Overview

A media item cache manager system is described herein which implementstechniques for efficiently using cache memory to respond to requestsreceived by a request processing system. The cache memory may includeinformation on media items along with a status indicator for each of themedia items, indicating different status information. Some examples ofpossible status indicators include valid, invalid, or in-progressindicators.

1.1 Native Content Items

The following is a sample use case of the media item cache managersystem used with requests for content items that are dynamicallypublished on a Web page. Although the specification may employ examplesusing this sample embodiment discussed below, the principles asdescribed herein are generally applicable to other types of systemswhere there are requests that need to be satisfied within (or regardlessof) a particular time constraint.

In an embodiment, the request processing system may be used to respondto requests where content items are used as part of a dynamicallypublished Web page. These content items may also be known as nativecontent items, an example type of which is advertisements. Nativecontent items are different than other content items since, instead ofspecifying the requirements for a single element to be displayed on aWeb page, native content items include two or more media items that willbe combined for display on a Web page. Each native content item mayinclude different media item requirements (e.g., information specifyingwhat media items with which types are needed and technical requirementsfor the media items). Further, requirements information may includetargeting information (e.g., information specifying whether a contentitem should be returned) and, for media items used to generate thenative content item,

1.2 Media Items

Media items may include any piece of content that may be displayed on acomputer screen. Some examples of different types of media items includetext, graphic, or video. Media items may also include additionalinformation that is not displayable on a computer screen. Some examplesinclude addressing information (e.g., a universal resource locator),identifying information on a content item provider that provided themedia item, or other pieces of information.

A single native content item may include one or more media items. Forexample, media items may be associated with one or more types. The typefor a media item defines where, for a native content item, the mediaitem may be used. Some examples of types include an icon image, a logoimage, a main image, a title, a call-to-action (CTA), a sponsor, adescription, or many other types. Different requests for native contentitems may require one or more of these types to be satisfied. Forexample, a native content item request may include a requirement for alogo image, a title, and a sponsor.

Some examples of media item requirements in addition to type include alimit on the dimensions for a graphic element (e.g., pixel count,resolution, height, length, width), a text element (e.g., charactercount, text length), or a video element (e.g., pixel count, resolution,height, length, width, video quality, playback time). For example, therequest processing system may include two or more media items with thetype of logo. This means that, for requests that require a logo to beincluded, the two or more media items may possibly satisfy therequirement. However, there may be size, color, theme, or otherattributes where the two or more logos differ. Some logos may be wider,while other logos may be narrower. Based on the requirements includedwith the request, the proper logo may be selected. As another example, arequest may require a length of 15 characters for a company name. Ifthere is a media item that satisfies the length requirement (15characters) and type requirement (is a company name), it may be selectedas part of the response to the request.

Further, additional changes may be applied to a selected media itemafter its selection. For example, in addition to the length requirement,before the media item is displayed as part of a Web page, the font,color, media item size, or other attribute of the media item may bemodified.

The flexibility of using different media items depending on a requestallows the reuse of media items (e.g., when a media item is selected foruse with two or more native content items) as well as allowing a Webpage to maintain a consistent “look and feel” (e.g., making sure contentitems properly fit in a specified space). However, this means thatnative content items lack predefined requirements of what media itemsshould be used. For example, there may be preferred requirements such asfonts, lengths, sizes and other attributes for media items used innative content items. TABLE 1 below includes, in an embodiment of therequest processing system, technical requirements for different mediaitem types.

TABLE 1 Media Item Type (media item category) Technical RequirementsIcon image (graphic) 320 × 180 pixels, 128 × 128 pixels, 80 × 80 pixelsLogo image (graphic) 128 × 128 pixels, 80 × 80 pixels, 48 × 48 pixelsMain image (graphic) 1200 × 627 pixels, 1000 × 750 pixels, 600 × 314pixels, 300 × 157 pixels Title (text) 25 characters, 20 characters Callto action (text) 25 characters, 15 characters Sponsor (text) 25characters Description (text) 100 characters, 90 characters, 72characters Video video duration (e.g., 15 seconds, 30 seconds, 1 minute,or other time); video bitrate; video aspect ratio; supported media fileformat (e.g., mp4, WebM, others)

If a content provider includes media items that comply with theserequirements, then the chances of the content provider being able toproperly respond to requests will increase. Since these are merelysuggestions, however, conforming to these requirements may still meanthat the content provider may not satisfy all possible requirements.

Further, native content items may be subject to a higher failure ratethan other types of content items generated in response to a request.This is because the time to select media items to produce a content itemfor a dynamically published Web page is the same or similar tonon-dynamically published Web pages. By using status indicators, themedia item cache manager system may increase the chance of timelyselecting media items. For example, a status indicator may indicate thata media item stored in a cache is usable or, if it is not usable, whatcan be done to retrieve the media item within a specified time frame.

2.0 Structural Overview

FIG. 1 illustrates a request processing system 100 in which one or moreof techniques described herein may be practiced according to certainembodiments. The request processing system 100 is a computer-basedsystem. The various components of the request processing system 100 areimplemented at least partially by hardware at one or more computingdevices, such as one or more hardware processors executing instructionsstored in one or more memories for performing various functionsdescribed herein. For example, descriptions of various components (ormodules) as described in this application may be interpreted asproviding pseudocode, an informal high-level description of one or morecomputer structures. The descriptions of the components may be convertedinto software code, including code executable by an electronicprocessor. The request processing system 100 illustrates only one ofmany possible arrangements of components configured to perform thefunctionality described herein. Other arrangements may include fewer ordifferent components, and the division of work between the componentsmay vary depending on the arrangement.

The request processing system 100 includes three separate systems thatmay operate in tandem or separately in the request processing system 100to select content items: a request filtration system 102, a content itemgeneration system 104, and a media item cache manager system 106.Although these systems include components divided into separate systems,the systems may communicate with each other or use information generatedby other systems, or components within each system may be rearrangeddifferently than the arrangements shown in FIG. 1. Further, differentembodiments of the request processing system 100 may include one, two,or all three of these systems, in different combinations, depending onspecific needs of the request processing system 100.

The request filtration system 102 may be responsible for reducing loadin the request processing system 100, by reducing the number of requeststo which the request processing system 100 responds. For example, therequest filtration system 102 implements techniques to reduce load on adownstream service by filtering requests before they are processed bythe downstream service. The request filtration system 102 may be used bythe request processing system 100 to eliminate requests that satisfy oneor more filters. Each filter may specify one or more attributes that mayapply to one or more requests. If a request satisfies any applicablefilter, then the request is not considered by the downstream service ora content item does not need to be selected by the request processingsystem 100 in response to the request. An example of the requestfiltration system 102 that may be used with the request processingsystem 100 is described in the related U.S. Patent Application titled“Reducing Load to Downstream Services by Filtering Requests,” asidentified above in the Related Cases section of this application.

The content item generation system 104 is responsible for selecting andidentifying content items to return in response to a request. Forexample, the content item generation system 104 may separaterequirements included with a request into first and second sets ofrequirements. The first set of requirements may be used to identifywhich content items or content item campaigns may be suitable to respondto the request. The second set of requirements may be used to determinewhether items associated with the selected content items or content itemcampaigns correspond to technical requirements associated with (e.g.,specified in) the request. An example of a content item generationsystem 104 that may be used with the request processing system 100 isdescribed in the related U.S. Patent Application titled “Multi-StepValidation of Content Items based on Native Content Item Requirements”and U.S. Patent Application titled “Increasing Coverage of Responses forRequests through Selecting Multiple Native Content Items,” as identifiedabove in the Related Cases section of this application.

A content item exchange 108 represents an entity that supplies requestsof content items to the request processing system 100. There may be oneor more content item exchanges that provide requests to the requestprocessing system 100 that are not shown in FIG. 1. Each content itemexchange may provide, to the request processing system 100, requests forone or more different media item types. For example, the content itemexchange 108 may be a real-time bidding (RTB) content item exchange. TheRTB content item exchange allows different parties to bid forimpressions on one or more Web pages. A winner of a bid obtains theright to include the winner's content item on the one or more Web pages.The winner of the bid may be any party that offers that highest value tothe content item exchange 108, such as revenue, content itemsuitability, or other factors determined by the content item exchange108. One content item exchange may provide requests for video, text,graphical, native video, native text, native graphical, or anycombination of these media item types.

A content item provider 110 represents an entity that supplies contentitems that may be selected for display in response to a request.Different entities may be content item providers. Some examples ofentities include organizations, advertisers, persons, companies, andmany other types of entities. The content item provider 110 may providevarious pieces of information to generate content items, such as mediaitems that are put together to form a content item, or complete contentitems themselves. The content item provider 110 may provide one or moremedia items of different types. Some examples of types of media itemsinclude audio, image, text, or video. Media items may also be associatedwith different types that define where they may be used in a contentitem and different media item types may be used for each type. Forexample, for a logo field, an image media item may be required, whilefor a company name, a text media item may be required.

The media item cache manager system 106 may be responsible for storing,in a cache memory (and retrieving from the cache memory), media itemsthat may be used to generate content items in the request processingsystem 100. A lookup component 112 is responsible for performing lookupsto a cache data store 114 to determine whether information on a mediaitem is stored at the cache data store 114. The cache data store 114 mayuse any suitable data structure, such as a table, linked list, or otherdata structures. Each cache entry in cache data store 114 includesinformation about at least one media item, such as the media item itselfand any information related to the media item. Media items stored in thecache data store 114 may include a key, a value, a status indicator, anda time to live (TTL).

An interpretation component 116 is responsible for processing results oflookups by the lookup component 112. For example, the interpretationcomponent 116 may determine whether a value stored for a media item inthe cache data store 114 is usable.

A media item query component 118 is responsible for making queries tothe media item data store 120. The media item data store 120 may be apart of the request processing system 100 as shown in FIG. 1 or may beseparate from the request processing system 100. Queries made to themedia item data store 120 may take longer than lookups to the cache datastore 114.

An update component 122 is responsible for updating the cache data store114. For example, based on results from the interpretation component 116or the media item query component 118, update component 122 may update avalue, a TTL, a status indicator, or any combination of these for acache entry.

3.0 Example Method for Using a Cache

For purposes of illustrating a clear example, FIGS. 2 and 3 aredescribed herein in the context of FIG. 1, but the broad principles ofFIGS. 2 and 3 can be applied to other systems having configurationsother than as shown in FIG. 1. Further, FIGS. 2 and 3 illustrate analgorithm or plan that may be used as a basis for programming one ormore of the components of FIG. 1 that relate to the functions that areillustrated in the diagram, using a programming development environmentor programming language that is deemed suitable for the task. Thus,FIGS. 2 and 3 are intended as an illustration at the functional level atwhich skilled persons, in the art to which this disclosure pertains,communicate with one another to describe and implement algorithms usingprogramming. This diagram is not intended to illustrate everyinstruction, method object or sub step that would be needed to programevery aspect of a working program, but are provided at the high,functional level of illustration that is normally used at the high levelof skill in this art to communicate the basis of developing workingprograms.

FIG. 2 is a flow 200 that illustrates an example method for using cachememory in the media item cache manager system 106. For example, thecache may include status indicators, which provide details on whetherinformation stored in the cache is usable and, if it is not, how toretrieve the information efficiently.

In step 202, the media item cache manager system 106 receives requestinformation. The request information does not need to include all theinformation received by the request processing system 100 when initiallyreceiving a request for a content item. The request received by therequest processing system 100 may be for a native content item. Therequest may originate from a content item exchange or from a publisher.The request may include a variety of information, such as targetinginformation on entities that made the requests, where selected contentitems may appear, or technical information on the requirements needed tosatisfy the request. The request information received by the media itemcache manager system 106 may be a subset of the information received bythe request processing system 100. For example, the request may haveincluded targeting information usable by the request processing system100 to determine that the content item is suitable to return in responseto the request. Instead of having all the information included in therequest (e.g., the targeting information), the media item cache managersystem 106 may receive information identifying which media items wouldbe needed to produce the content item in response to the requestreceived by the request processing system 100.

In step 204, the media item cache manager system 106 determines mediaitems that may be used to generate the content item. To generate acontent item means to select media items that may be used to render thecontent item. The content item itself does not need to be provided inresponse to the request, but instead information specifying whereselected media items may be retrieved may be provided. For example, acontent item provider may provide one or more media items to the requestprocessing system 100. In response to a request for one or more contentitems, the media item cache manager system 106 may select media itemsfrom a content item provider that satisfies the request. The request mayspecify one or more requirements that media items used to respond to therequest must comply with, such as a location within the content item themedia item may be used (e.g., type of the media item). The request mayspecify that a content item that satisfies the request includes acompany name (a text type media item), a logo image (an image type mediaitem), and a tag line or comment (a text type media item).

In step 206, the media item cache manager system 106 performs a cachelookup for a selected media item, using a key for the selected mediaitem. For example, each media item of the media item cache managersystem 106 includes a key identifying the media item. The information onwhich media items needed to generate a content item in response to arequest are included in the request information from the step 202. Therequest information may include the keys themselves or information thatmay be processed to determine what keys should be used, such as acampaign identifier related to specific media items. Using the key forthe selected media item, a cache lookup is performed, such as looking ina cache table to determine whether there is an entry for the key in thecache table.

3.1 Determine Whether Cache Result is Usable

In step 208, the media item cache manager system 106 determines whethera result of the cache lookup is a usable result. There may be a varietyof reasons why the result may or may not be a usable result. One reasonwhy there may not be a usable result is that there may be no entry inthe cache that corresponds to the key. There may be no entry when thecache is newly established, so that there are none or few media itemsstored in the cache. As another example, the cache may previously havestored an entry with information associated with the key, but theinformation has been removed from the cache as part of a cleaningprocess of the cache where, for example, entries have been flushed ordeleted if their contents have been in cache for a certain period oftime or their contents have not been accessed for a certain period oftime.

Even if there is a result or entry in the cache corresponding to thekey, the result may be usable or unusable. In an embodiment, the mediaitem cache manager system 106 includes entries in the cache, each entrywith a status indicator and a time to live (TTL). The status indicatorand/or the TTL may affect whether information in a cache entry isusable. TABLE 1 below includes, in an embodiment of the media item cachemanager system 106, how a status indicator in combination with anindication of whether a TTL has expired may affect the usability ofinformation in the cache.

TABLE 2 Success Failure In-Progress TTL Not Usable Cache miss. Wait thentry cache Expired cache Return error lookup again. If success value. orother status indicator, then Return indication return cache value. Ifvalue in that the fail or in-progress, then cache. media item returnerror or other cannot be indication that the media retrieved. itemcannot be retrieved. TTL Execute query to retrieve value from data storeand change Expired status to in-progress. If response time exceeds anavailable time but value can be retrieved, then update cache with value,TTL, and status indicator. If response time is within the availabletime, then return value.

If, in step 208, the media item cache manager system 106 determines thatthe cache value is usable, then, in step 215, the media item cachemanager system 106 saves information on the usable media item. This mayinclude saving value information (e.g., a location where the media itemmay be retrieved) for the selected media item. The value information forthe selected media item may be saved until value information for all themedia items required to respond to a request are retrieved.

3.2 Unusable Cache Result

If, in step 208, the media item cache manager system 106 determines thatthe result is unusable, then, in step 210, the media item cache managersystem 106 determines whether a Usable result may be returned otherwise.Using TABLE 2 as an example, this may correspond to when (1) the TTL forthe result has expired or (2) the status indicator is a failureindicator or an in-progress indicator. If, in step 210, the media itemcache manager system 106 determines that a usable result cannot bereturned, then, in step 212, the media item cache manager system 106determines that the request for the content item cannot be satisfied.Using TABLE 2 as an example, this may correspond to when (1) the TTL forthe result has expired and retrieving the value exceeds an availabletime to respond to the request or (2) the status indicator is a failure.As discussed in greater detail elsewhere in this application, theavailable time to respond to a request may be calculated from how muchtime has elapsed from transmitting of the request to the step 208. Thismay include time that has not yet been spent, but may be estimated andincluded in determining whether there is available time to respond.

If, in step 210, the media item cache manager system 106 determines ausable result may be returned without the cache, then, in step 214, themedia item cache manager system 106 updates the cache, if needed. UsingTABLE 2 as an example, this may correspond to when (1) the TTL for thecached value has expired and retrieving the cached value is within theavailable Time to respond to the request or (2) the status indicatorafter waiting due to the in-progress indicator is a success indicator.Different updates may be made to the cache depending on how the usableresult was determined, if it is not found in the cache. For example, theTTL for the key may be updated to reflect when the media item wasretrieved. Further, the status indicator may be changed depending on theoutcome for the media item request. For example, if a result isreturned, then a status indicator may be updated to a successindication, a timestamp updated, a value updated, and a TTL updated. Theresult does not necessarily mean that the result is usable with thepresent request (e.g., time to respond has expired or predicted toexpire before the result is available), but may be usable for subsequentrequests to the cache.

In step 216, the media item cache manager system 106 determines whetherthe request specifies additional media items necessary to respond to therequest. If there are additional media items, then the media item cachemanager system 106 returns to step 206.

If, in the step 216, there are no additional media items, then the mediaitem cache manager system 106 transmits media item information inresponse to the request. For example, the response may include the oneor more media items or an indication of where each media item isaccessible, such as a URL.

3.3 Media Items Retrieved Simultaneously

Embodiments of the media item cache manager system 106 may includeprocessing of media items in parallel or simultaneously. For example, ifthere are two or more media items needed to respond to a request, all ora part of the two or more media items may be processed by the media itemcache manager system 106 at the same time or at least partiallyoverlapping in time. This increases the general throughput of the mediaitem cache manager system 106. For example, instead of retrieving mediaitems sequentially, results may be retrieved faster by retrieving mediaitems in parallel using, for example, two or more threads of execution.

In an embodiment, when media items are being retrieved simultaneously,if the media item cache manager system 106 determines that any of themedia items cannot be retrieved for the request, then other retrievalsfor media items to satisfy the request may cease. For example,incomplete content items (e.g., content items missing one or more mediaitems) cannot be displayed to a user or, even if displayed, would be oflow value. Thus, once one media item cannot be retrieved, the entirerequest may be deemed to have failed. Any other retrievals of mediaitems for the request may cease.

4.0 Example Method for Preloading Information

FIG. 3 is a flow 300 that illustrates an example method for preloadinginformation to a cache in the media item cache manager system 106. Whena request processing system 100 receives a request, one or more mediaitems may be selected in response to the request. In addition to the oneor more media items selected in response to the request, there may beadditional media items that the media item cache manager system 106 mayretrieve. These media items do not need to be explicitly selected tosatisfy any particular requirement included in the request. This isbecause when a media item is chosen, other related media items may havea chance to also be needed for subsequent requests. As an example, arequest may require a graphic media item. When retrieving the graphicmedia item from a cache or a data store, the media item cache managersystem 106 loads location information for the graphic media item andalso location information for other related graphic media items (e.g.,graphic media items with different sizes). This may increase overallprocessing speed in the request processing system 100 since, based onprevious requests for a media item, this indicates there is a higherlikelihood that related media items to the media item will be requestedsoon.

In step 302, the media item cache manager system 106 receives a requestfor a content item. In step 304, the media item cache manager system 106determines that the request may be satisfied by a set of media items. Instep 306, the media item cache manager system 106 selects a media itemof the set of media items.

In step 308, the media item cache manager system 106 determines whetherthe selected media item is stored in a cache. For example, using the keycorresponding to the selected media item, a cache table is searched forwhether there is an entry that corresponds to the selected media item.

If the media item is in the cache, in step 310, then the media itemcache manager system 106 provides the media item from the cache. Thismay include information on where the media item is found in the cacheand not the media item itself. In step 322, the media item cache managersystem 106 determines whether there are additional media items in theset of media items. For example, there may be additional media itemsthat require information on where the media item is stored to satisfythe request.

In step 312, the media item cache manager system 106 executes a query ata data store (e.g., media item data store 120) to retrieve the selectedmedia item. The cache may provide data to the media item cache managersystem 106 with lower latency than the data store. For example, the datastore may be a memory storage device, different than the cache. Thememory storage device may be a computer device separate from the one ormore computer devices executing the media item cache manager system 106.

4.1 Available Time to Respond to Request

In step 314, the media item cache manager system 106 determines whetherthe time to respond to the selected request may be met. For example, therequest may have originated from a content item exchange. From the timewhen a request from the content item exchange is transmitted to the timethe content item exchange receives a response to the request, there maybe different time requirements. Some lengths of time might include 80milliseconds, 100 milliseconds, or 120 milliseconds. If a responsearrives at the content item exchange after this period of time, then thecontent item exchange may choose to not consider the response, even ifthe response is otherwise satisfactory.

The media item cache manager system 106 may calculate how much time haselapsed from transmitting of the request, to the time when step 314 isperformed, to determine whether there is available time to respond. Thismay include time that has not yet been spent, but may be estimated andincluded in whether there is additional time. For example, the mediaitem cache manager system 106 may include, in addition to the responsetime currently elapsed, an additional time it would take a response toreach the content item exchange. This estimated time to reply is used todetermine whether there is additional time to satisfy the request. Ifthere is additional time, then the media item cache manager system 106may predict that the request may still be satisfied.

In an embodiment, the media item cache manager system 106 makes aprediction, based on previous requests to the data store, on whether themedia item may be retrieved within the specified time. For example, ifresponses to previous requests to the data store took an average of 15milliseconds, then the media item cache manager system 106 may includethe 15 milliseconds to the estimated time to reply.

4.2 Related Media Items

If there is not enough additional time to respond, then, in optionalstep 316, the media item cache manager system 106 retrieves the selectedmedia item from the data store and related media items. Information onthe selected media item and related media items may then be stored inthe cache. Related media items may be media items similar to theselected media item, but with one or more differences than the selectedmedia item. For example, a “related media item” may be a media item witha different size, length, quality, or other attribute different than theselected media item. In an embodiment, a related media item is one thatincludes the same type as the selected media item. The related mediaitems may be media items that were not explicitly requested from thedata store for use in responding to the request.

In step 318, the media item cache manager system 106 determines to notrespond to the request. For example, the media item cache manager system106 may indicate to the request processing system 100 to transmit amessage to a content item exchange that a content item will not beprovided or the media item cache manager system 106 may simply notrespond to the content item exchange for the request.

In step 320, the media item cache manager system 106 retrieves theselected media item from the data store and related media items.Information on the selected media item and related media items may thenbe stored in the cache.

In step 322, the media item cache manager system 106 determines whetherthere are additional media items in the set of media items. For example,in order to create a content item, there may be one or more media items.If there are additional media items, then they are retrieved by themedia item cache manager system 106. In an embodiment, media items maybe retrieved simultaneously, as described in greater detail elsewhere inthis application.

In step 324, the media item cache manager system 106 providesinformation regarding the set of media items in response to the request.This may include one or more locations where media items for the contentitem may be retrieved.

5.0 Example Embodiment of a Media Item Cache Manager System

In an embodiment, the media item cache manager system 106 includes acache table including entries on results of requests made to a mediaitem data store. Any suitable data structure may be used to implementthe cache table, such as a list, queue, table, array, hash table, ormany other data structures. The cache table may include various piecesof information on media items, such as a key (e.g., used to identify amedia item), a value (e.g., a location from where a media item may beretrieved), a status indicator, a timestamp, and a time to live (TTL).

The media item cache manager system 106 receives request informationfrom one or more content item requesters. The content item requestorsmay be users viewing Web pages or a content item exchange thataggregates requests from users. For each request, the media item cachemanager system 106 determines a media item to include in a response tothe request. For example, the response may include a content item topresent to a user. The content item may be generated using one or moremedia items. This may include determining a media item type and a mediaitem dimension for a first media item. A second media item determined inresponse to the request may be of a different media item type than thefirst media item. For example, the first media item may be a graphicalmedia item and the second media item may be a text media item.

In various embodiments, the media item cache manager system 106 may usedifferent pieces of information to identify media items. For example,there may be a single key or a composite of keys that correspond to adesired media item. The composite of keys may include one or more of acontent identifier with locale information or metadata of the contentitem (e.g., title, description in that locale language, image URL, logoURL) related to the content item. A single key may include a contentprovider identifier, such as the content provider's industry categoryinformation. The single key or composite of keys may be used inconjunction to identify the desired media item.

For a media item, the media item cache manager system 106 performs alookup for the media item in the cache table. For example, a tablelookup or a database query may be executed in response to the lookup.The media item cache manager system 106 receives a response as a resultof the performed lookup, where the response includes a status indicatorfor the performed lookup. Different status indicators may determine howthe media item cache manager system 106 retrieves the media item.

For an in-progress status indicator for the performed lookup, the mediaitem cache manager system 106 determines, based on the in-progressstatus indicator, to wait for a period of time, without requesting themedia item from the media item data store 120. For example, thein-progress status indicator may further include a timestamp of when thein-progress status indicator was set. Based on the period of time towait and the timestamp, the media item cache manager system 106determines whether it should wait longer (e.g., the period of time towait is likely not to expire based on the timestamp) or whether themedia item cache manager system 106 should proceed without waiting(e.g., period of time to wait is likely to expire based on the timespecified by the timestamp).

The period of time to wait may vary, depending on various factors. In anembodiment, the period of wait is a set amount of time (e.g., 5milliseconds, 10 milliseconds, 15 milliseconds, or less). The lower theset amount of time, the lower the likelihood that the media item cachemanager system 106 may retrieve the value information for a media item.In another embodiment, the period of time to wait is dependent on anexpected length of time that executing a query against the media itemdata store 120 should take. For example, if it is expected that, basedon previous queries to the media item data store 120 or test attempts tothe media item data store 120, it will take 5 milliseconds to receive aresult from the media item data store, then the media item cache managersystem 106 may wait for 5 or fewer milliseconds before performinganother lookup for the media item. In this example, if the timestamp wasset 3 milliseconds ago, then the media item cache manager system 106 maywait just two or a few more milliseconds (e.g., a buffer) (i.e., 5milliseconds-3 milliseconds).

After the period of time has elapsed, the media item cache managersystem 106 performs another lookup to the cache table without requestingthe media item from the media item data store. For example, the previousrequest that caused the status indicator to be in-progress may havecompleted and updated the cache table. This may be because thein-progress indicator indicates that a previous request to the mediaitem data store has been made. Since a request has already been made tothe media item data store for the media item, there is no need for anadditional request. This conserves computing resources (e.g., reducingnetwork load with requests) and decreases the possible time to retrievethe media item (e.g., a previously made request to the media item datastore will likely complete first).

In an embodiment, after identifying an in-progress status indicator froma first lookup and after the period of time has elapsed, if the secondlookup includes a success status indicator, then the media item cachemanager system 106 retrieves, from the cache table, information on themedia item in response to each request. For example, this may includethe media item itself or a URL or other location information specifyingwhere the media item may be retrieved. The location information may beused by a user's computer to retrieve the media item in order toproperly render the content item for display.

In an embodiment, for a success status indicator for a first lookup, themedia item cache manager system 106 determines whether a time to live(TTL) stored in the cache table and associated with the media item hasexpired. If the TTL has not expired, then the media item cache managersystem 106 retrieves, from the cache table, information on the mediaitem in response to each request.

In an embodiment, for a failure status indicator for a first lookup, themedia item cache manager system 106 determines whether a time to live(TTL) stored in the cache table and associated with the media item hasexpired. If the TTL has expired, then the media item cache managersystem 106 executes a query against the media item data store 120 toretrieve the media item. The media item cache manager system 106 changesthe failure status indicator for the media item in the cache table to anin-progress status. For example, if a previous request had failed (e.g.,network issues, data store errors), then the cache table may indicatethat the previous request was unable to be completed (e.g., using afailure status indicator). The failure status indicator may indirectlyreflect the result of previous requests, but does not necessarilyinclude the reason why the previous results may have failed.

However, if the TTL has expired, then the failure status indicator maybe stale. In other words, the reason that caused the previous request tofail may have been remedied and the data store should be tried again.

If the query results in a valid result, then the media item cachemanager system 106 changes the failure status indicator for the mediaitem in the cache table to a valid status indicator. The media itemcache manager system 106 updates the cache table with the valid resultof the executed query against the media item data store. If the queryreturns an invalid result, then the media item cache manager system 106updates the cache table with a time to live (TTL) associated with themedia item. For example, the TTL may be extended in this case, since thedata store has failed to return the media item information at leasttwice.

In an embodiment, if the media item cache manager system 106 fails toidentify the media item in the cache, then the media item cache managersystem 106 executes a query against the media item data store toretrieve the media item. For example, the cache table may have recentlystarted storing media items or the media item may be a media item thathad not been recently requested.

6.0 Implementation Example—Hardware Overview

According to one embodiment, the techniques described herein areimplemented by one or more special-purpose computing devices. Thespecial-purpose computing devices may be hard-wired to perform thetechniques, or may include digital electronic devices such as one ormore application-specific integrated circuits (ASICs) or fieldprogrammable gate arrays (FPGAs) that are persistently programmed toperform the techniques, or may include one or more general purposehardware processors programmed to perform the techniques pursuant toprogram instructions in firmware, memory, other storage, or acombination. Such special-purpose computing devices may also combinecustom hard-wired logic, ASICs, or FPGAs with custom programming toaccomplish the techniques. The special-purpose computing devices may bedesktop computer systems, portable computer systems, handheld devices,networking devices or any other device that incorporates hard-wiredand/or program logic to implement the techniques.

For example, FIG. 4 is a block diagram that illustrates a computersystem 400 upon which an embodiment of the invention may be implemented.Computer system 400 includes a bus 402 or other communication mechanismfor communicating information, and a hardware processor 404 coupled withbus 402 for processing information. Hardware processor 404 may be, forexample, a general purpose microprocessor.

Computer system 400 also includes a main memory 406, such as a randomaccess memory (RAM) or other dynamic storage device, coupled to bus 402for storing information and instructions to be executed by processor404. Main memory 406 also may be used for storing temporary variables orother intermediate information during execution of instructions to beexecuted by processor 404. Such instructions, when stored innon-transitory storage media accessible to processor 404, rendercomputer system 400 into a special-purpose machine that is customized toperform the operations specified in the instructions.

Computer system 400 further includes a read only memory (ROM) 408 orother static storage device coupled to bus 402 for storing staticinformation and instructions for processor 404. A storage device 410,such as a magnetic disk, optical disk, or solid-state drive is providedand coupled to bus 402 for storing information and instructions.

Computer system 400 may be coupled via bus 402 to a display 412, such asa cathode ray tube (CRT), for displaying information to a computer user.An input device 414, including alphanumeric and other keys, is coupledto bus 402 for communicating information and command selections toprocessor 404. Another type of user input device is cursor control 416,such as a mouse, a trackball, or cursor direction keys for communicatingdirection information and command selections to processor 404 and forcontrolling cursor movement on display 412. This input device typicallyhas two degrees of freedom in two axes, a first axis (for example, x)and a second axis (for example, y), that allows the device to specifypositions in a plane.

Computer system 400 may implement the techniques described herein usingcustomized hard-wired logic, one or more ASICs or FPGAs, firmware and/orprogram logic which in combination with the computer system causes orprograms computer system 400 to be a special-purpose machine. Accordingto one embodiment, the techniques herein are performed by computersystem 400 in response to processor 404 executing one or more sequencesof one or more instructions contained in main memory 406. Suchinstructions may be read into main memory 406 from another storagemedium, such as storage device 410. Execution of the sequences ofinstructions contained in main memory 406 causes processor 404 toperform the process steps described herein. In alternative embodiments,hard-wired circuitry may be used in place of or in combination withsoftware instructions.

The term “storage media” as used herein refers to any non-transitorymedia that store data and/or instructions that cause a machine tooperate in a specific fashion. Such storage media may comprisenon-volatile media and/or volatile media. Non-volatile media includes,for example, optical disks, magnetic disks, or solid-state drives, suchas storage device 410. Volatile media includes dynamic memory, such asmain memory 406. Common forms of storage media include, for example, afloppy disk, a flexible disk, hard disk, solid-state drive, magnetictape, or any other magnetic data storage medium, a CD-ROM, any otheroptical data storage medium, any physical medium with patterns of holes,a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip orcartridge.

Storage media is distinct from but may be used in conjunction withtransmission media. Transmission media participates in transferringinformation between storage media. For example, transmission mediaincludes coaxial cables, copper wire and fiber optics, including thewires that comprise bus 402. Transmission media can also take the formof acoustic or light waves, such as those generated during radio-waveand infra-red data communications.

Various forms of media may be involved in carrying one or more sequencesof one or more instructions to processor 404 for execution. For example,the instructions may initially be carried on a magnetic disk orsolid-state drive of a remote computer. The remote computer can load theinstructions into its dynamic memory and send the instructions over atelephone line using a modem. A modem local to computer system 400 canreceive the data on the telephone line and use an infra-red transmitterto convert the data to an infra-red signal. An infra-red detector canreceive the data carried in the infra-red signal and appropriatecircuitry can place the data on bus 402. Bus 402 carries the data tomain memory 406, from which processor 404 retrieves and executes theinstructions. The instructions received by main memory 406 mayoptionally be stored on storage device 410 either before or afterexecution by processor 404.

Computer system 400 also includes a communication interface 418 coupledto bus 402. Communication interface 418 provides a two-way datacommunication coupling to a network link 420 that is connected to alocal network 422. For example, communication interface 418 may be anintegrated services digital network (ISDN) card, cable modem, satellitemodem, or a modem to provide a data communication connection to acorresponding type of telephone line. As another example, communicationinterface 418 may be a local area network (LAN) card to provide a datacommunication connection to a compatible LAN. Wireless links may also beimplemented. In any such implementation, communication interface 418sends and receives electrical, electromagnetic or optical signals thatcarry digital data streams representing various types of information.

Network link 420 typically provides data communication through one ormore networks to other data devices. For example, network link 420 mayprovide a connection through local network 422 to a host computer 424 orto data equipment operated by an Internet Service Provider (ISP) 426.ISP 426 in turn provides data communication services through the worldwide packet data communication network now commonly referred to as the“Internet” 428. Local network 422 and Internet 428 both use electrical,electromagnetic or optical signals that carry digital data streams. Thesignals through the various networks and the signals on network link 420and through communication interface 418, which carry the digital data toand from computer system 400, are example forms of transmission media.

Computer system 400 can send messages and receive data, includingprogram code, through the network(s), network link 420 and communicationinterface 418. In the Internet example, a server 430 might transmit arequested code for an application program through Internet 428, ISP 426,local network 422 and communication interface 418.

The received code may be executed by processor 404 as it is received,and/or stored in storage device 410, or other non-volatile storage forlater execution.

In the foregoing specification, embodiments of the invention have beendescribed with reference to numerous specific details that may vary fromimplementation to implementation. The specification and drawings are,accordingly, to be regarded in an illustrative rather than a restrictivesense. The sole and exclusive indicator of the scope of the invention,and what is intended by the applicants to be the scope of the invention,is the literal and equivalent scope of the set of claims that issue fromthis application, in the specific form in which such claims issue,including any subsequent correction.

What is claimed is:
 1. A method comprising: receiving a plurality ofrequests from one or more content item requesters; for each request ofthe plurality of requests: determining a media item to include in aresponse to said each request; causing to be performed a lookup for themedia item to a cache stored at one or more data stores; receiving acache response as a result of the lookup, wherein the cache responseincludes a status indicator for the media item to be stored in thecache, wherein the status indicator is stored in the cache; if thestatus indicator is an in-progress status indicator, then: determining,based on the in-progress status indicator, to wait for a period of time,without requesting, from a media item data store, the media item; afterthe period of time has elapsed, causing to be performed another lookupto the cache without requesting, from the media item data store, themedia item; if the status indicator is a failure status indicator, thenrequesting the media item from the media item data store; wherein themethod is performed by one or more computing devices.
 2. The method ofclaim 1, wherein the status indicator is the in-progress statusindicator, further comprising: after the period of time has elapsed, inresponse to determining that the other lookup results in a successstatus indicator, retrieving, from the cache, information on the mediaitem in response to said each request.
 3. The method of claim 1, whereinfor a second request of the plurality of requests, a second lookup isperformed for a second media item that is determined to be included in asecond response to the second request, further comprising: in responseto identifying a success status indicator for the second lookup:determining whether a time to live (TTL) stored in the cache andassociated with the second media item has expired; if the TTL has notexpired, then retrieving, from the cache, information on the secondmedia item in response to said second request.
 4. The method of claim 1,wherein for a second request of the plurality of requests, a secondlookup is performed for a second media item that is determined to beincluded in a second response to the second request, further comprising:in response to identifying a failure status indicator for the secondlookup: determining whether a time to live (TTL) stored in the cache andassociated with the second media item has expired; if the TTL hasexpired: causing a query to be executed against a second media item datastore to retrieve the second media item; changing the failure statusindicator for the second media item in the cache to an in-progressstatus.
 5. The method of claim 4, further comprising: for the failurestatus indicator for the second lookup and after changing the failurestatus indicator: in response to determining that an executed queryreturns a valid result: changing the failure status indicator for thesecond media item in the cache to a valid status indicator; updating, inthe cache, an entry for the second media item with the valid result ofthe executed query against the media item data store.
 6. The method ofclaim 4, further comprising: for a failure status indicator for thelookup and after changing the failure status indicator: in response todetermining that the executed query returns an invalid result: updating,in the cache, for the second media item, a time to live (TTL) associatedwith the second media item.
 7. The method of claim 1, wherein for asecond request of the plurality of requests, a second lookup isperformed for a second media item that is determined to be included in asecond response to the second request, further comprising: in responseto determining that the second lookup fails to identify the second mediaitem, causing a query to be executed against the media item data storeto retrieve the second media item.
 8. The method of claim 1, whereindetermining the media item to include further comprises determining amedia item type and a media item dimension for the media item.
 9. Themethod of claim 1, wherein the media item comprises at least one of avideo, a text, or a graphical type of media item.
 10. The method ofclaim 1, further comprising: determining another media item to includein the response to said each request, wherein the media item comprises agraphical media item and the other media item comprises a text mediaitem.
 11. The method of claim 1, wherein determining the media itemincludes determining a type the media item may be used when generating acontent item in response to said request.
 12. The method of claim 1,wherein the media item data store resides on one or more computingdevices separate from one or more computing devices that include thecache.
 13. The method of claim 1, wherein the media item is representedin the cache including a key, a value, a status indicator, and a time tolive (TTL).
 14. The method of claim 1, wherein for a second request ofthe plurality of requests, a second lookup is performed for a secondmedia item that is determined to be included in a second response to thesecond request, further comprising: in response to identifying thein-progress status indicator for the second lookup made in response tothe second request of the plurality of requests, in response to asubsequent lookup for the second media item resulting in a successstatus indicator, retrieving, from the cache, information on the secondmedia item in response to the second request.
 15. One or more storagemedia storing instructions which, when executed by one or moreprocessors, cause: receiving a plurality of requests from one or morecontent item requesters; for each request of the plurality of requests:determining a media item to include in a response to said each request;causing to be performed a lookup for the media item to a cache residingon one or more data stores; receiving a cache response as a result ofthe lookup, wherein the cache response includes a status indicator forthe media item to be stored in the cache, wherein the status indicatoris stored in the cache; if the status indicator is an in-progress statusindicator, then: determining, based on the in-progress status indicator,to wait for a period of time, without requesting, from a media item datastore, the media item; after the period of time has elapsed, causing tobe performed another lookup to the cache without requesting, from themedia item data store, the media item; if the status indicator is afailure status indicator, then requesting the media item from the mediaitem data store.
 16. The one or more storage media of claim 15, whereinthe status indicator is the in-progress status indicator, wherein theinstructions, when executed by the one or more processors, furthercause: after the period of time has elapsed, in response to determiningthat the other lookup results in a success status indicator, retrieving,from the cache, information on the media item in response to said eachrequest.
 17. The one or more storage media of claim 15, wherein for asecond request of the plurality of requests, a second lookup isperformed for a second media item that is determined to be included in asecond response to the second request, wherein the instructions, whenexecuted by the one or more processors, further cause: in response toidentifying a failure status indicator for the second lookup:determining whether a time to live (TTL) stored in the cache andassociated with the second media item has expired; if the TTL hasexpired: causing a query to be executed against a second media item datastore to retrieve the second media item; changing the failure statusindicator for the second media item in the cache to an in-progressstatus.
 18. A system comprising: one or more processors; one or moredata stores including a cache used to store results of requests made toa media item data store; one or more storage media storing instructionswhich, when executed by the one or more processors, cause: receiving aplurality of requests from one or more content item requesters; for eachrequest of the plurality of requests: determining a media item toinclude in a response to said each request; causing to be performed alookup for the media item to a cache residing on one or more datastores; receiving a cache response as a result of the lookup, whereinthe cache response includes a status indicator for the media item to bestored in the cache, wherein the status indicator is stored in thecache; if the status indicator is an in-progress status indicator, then:determining, based on the in-progress status indicator, to wait for aperiod of time, without requesting, from the media item data store, themedia item; after the period of time has elapsed, causing to beperformed another lookup to the cache without requesting, from the mediaitem data store, the media item; if the status indicator is a failurestatus indicator, then requesting the media item from the media itemdata store.
 19. The system of claim 18, wherein for a second request ofthe plurality of requests, a second lookup is performed for a secondmedia item that is determined to be included in a second response to thesecond request, wherein the instructions, when executed by the one ormore processors, further cause: in response to determining that thesecond lookup fails to identify the second media item, causing a queryto be executed against the media item data store to retrieve the secondmedia item.
 20. The system of claim 18, wherein determining the mediaitem to include further comprises determining a media item type and amedia item dimension for the media item.